
SYSTEM AND METHOD FOR MAILING LIST TESTING SERVICE 

The present invention relates to direct-marketing mailing lists. In particular, the 
present invention relates to systems and methods for selecting appropriate direct- 
marketing mailing lists. 

BACKGROUND OF THE INVENTION 



Marketing Logistics, a research firm that monitors the direct marketing industry, 
reports that mail order sales of personal computers, consumer electronics and related 
products reached $1.5 billion in 1985. Business-to-business mail order sales for computer 
software and data processing supplies for the same year were $1.7 billion. The Direct 
Marketing Association, a trade group, reports that revenue from direct marketing for all 
product categories, now around $44 billion, is growing 1 0 percent a year ~ about twice as 
fast as retail. 

Ly businesses practice direct marketing by utilizing commercially-obtained 
mailing lists, rh^se lists can be obtained from mailing list brokers such as Best's Mailing 
List, Inc . (http://www.be^tqiailingxom/ ; visited on February 24, 1999) or Nationwide Data 
Services (http://www.nation\vi5b4ata.com/ ; visited on February 14, 1999). Such mailing lists 
are typically compiled from variobsssources such as public real-estate documents, census 
bureaus, financial publications, and direfetmail respondents. Members of the list, that is, 
people whose information is used to compilethe^ list, typically consist of individuals who 
have provided information about their lifestyles anchj^roduct usage through detailed 
surveys. For example, computer hardware or software purchasers that send in software 
and hardware vendor registration cards and surveys are typically placed on a mailing list 
gea red towards the PC and technology industry . 

Mailing list brokers exist and can supply a business with a multitude of lists from 
which to choose. Additionally, mailing list brokers can supply a business with lists of 
different formats, and try to accommodate the business' s preferences. Alternatively, 
businesses can obtain personalized mailing lists geared towards their needs by consulting 
with a mailing list manager directly rather than going through a broker. The business then 
utilizes these mailing lists by sending out promotional items such as brochures, 
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advertisements, or sale offers to persons included on the lists. 

Businesses typically consider finding appropriate lists a problem. Also, 
skyrocketing paper prices and production expenses, as well as rising postage prices, have 
made it increasingly difficult to do cost-effective mailings. It is believed that the choice of 
mailing list is one of the most critical factors related to the success of a direct marketing 
campaign. This is because the best list can often result in ten times the response as the 
worst list for an identical mailing piece. 

Unfortunately, approximately 40,000 different mailing lists exist that are available 
for rental today, making it difficult to pick the most appropriate list, and expensive to try 
multiple lists. Because of this, a business will typically purchase a mailing list without 
any indication of how successful the list will be for the business's particular purposes. 
Mailing lists are generally updated based on the responses of the individuals included on a 
mailing list. For example, if an individual on a mailing list has not responded to any 
mailings in the past year, he can be taken off the mailing list. In the meantime, however, 
businesses are purchasing mailing lists without being able to predict the number of 
responses to be expected from a given list. The most that a business or mailing list broker 
knows is the historical response rate of the individuals contained on the list to direct 
mailings of a general nature. There is no way for a business to judge just how effective a 
mailing list is for their particular product or service until the list is actually used. 

Internet based mailing lists which include e-mail addresses for direct marketing are 
also becoming popular. This type of direct marketing offers several advantages over 
postal marketing. For example, e-mail campaigns can be set up and executed in a 
relatively short amount of time, and can begin to generate responses almost immediately. 
Also, it is possible to deliver several hundred thousand e-mails an hour and to easily track 
all phases of the status of delivery and response from a mailer's desktop. The impact of a 
direct marketing e-mail mailing is not nearly as high as that of a postal mailing, however. 
The postal mailing is a more tangible good in the prospective consumer's hand. Also a 
person is more likely to flip through a longer brochure at home than to click through one at 
their PC terminal. Thus, e-mail can be an excellent vehicle for relatively small brochures, 
but the postal mailing remains the most effective process for attracting the buying power 
of a consumer. 

Thus, a need exists for a business to be able to efficiently and cost-effectively 



select an appropriate postal mailing list before investing a large amount of resources into 
utilizing the mailing list. 

SUMMARY OF THE INVENTION 

5 

To alleviate the problems inherent in the prior art, the present invention discloses 
systems and methods for creating and selecting a mailing list. 

In one embodiment of the present invention, a method for providing a mailing list 
■ test service is disclosed. This mailing list test service tests a plurality of mailing lists, each 
t io mailing list including information about a plurality of list members. To perform the test, a 
computer-based message, such as an electronic mailing (e-mail), is sent to each of a subset 
of list members for each mailing list. At least one response from a list member is 
received, and based on the received responses, one of the mailing lists is selected for use 
y| in a postal mailing campaign. 

rt 

s i BRIEF DESCRIPTION OF THE DRAWINGS 

^ Figure 1 is a block diagram overview of the system of the present invention. 

P Figure 2 is a schematic block diagram of the central server according to an 

|2f) embodiment of the present invention. 

[Z Figure 3 is a tabular representation of a mailing list database according to an 

y| embodiment of the present invention. 

Figure 4 is a tabular representation of a recipient database according to an 
embodiment of the present invention. 
25 Figure 5 A is a tabular representation of a test database according to an embodiment 

of the present invention. 

Figure 5B is a tabular representation of a test database and exemplary records from 
a questions database according to an embodiment of the present invention. 

Figure 6A is a tabular representation of a transaction database according to an 
30 embodiment of the present invention. 

Figure 6B is a tabular representation in which test e-mails can be used to get 
feedback on the potential postal mailings. 
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Figure 7 is a flow chart of a method of practicing an embodiment of the present 
invention. 

Figure 8 is a flow chart depicting an exemplary method of creating a test e-mail according 
to an embodiment of the present invention. 
5 Figure 9 is a flow chart depicting an exemplary method of receiving a response to a 

test e-mail according to an embodiment of the present invention. 

Figure 1 0 is a flow chart depicting an exemplary method of analyzing the results of 
a test e-mail and selecting the most effective postal mailing list to use according to an 
embodiment of the present invention. 

10 

... j 

DETAILED DESCRIPTION 

The present invention is a method and system for providing a mailing list test 
yj service. As a contextual example, but not the only example, of the present invention, 
y|5 consider a small business that desires to directly market its goods by mailing brochures to 
"~-J potential customers. This small business can employ the service of a mailing list broker 
OB and select one of the many mailing lists to use in its marketing efforts. Of course, as 
^ F discussed above, selecting the appropriate list is crucial in the business' s marketing 

efforts, and so the small business is faced with making a guess as to which mailing list 
op would be most effective for their particular product. 

^ To avoid such guesswork, the small business can employ the services of a mailing 

yj list broker that practices the present invention. This mailing list broker can use e-mail lists 
that correlate to postal mailing lists to pre-test the effectiveness of the postal mailing list. 
Because of this correlation, e-mail lists serve as a reliable response predictor of its 

25 associated postal mailing list. In this contextual example, e-mail-list corresponds to 

members of a postal mailing list. That is, for each e-mail address there is an individual 
postal mailing address contained in the mailing list. For example, e-mail addresses may 
be stored in a database in association with the postal mailing address of each list member 
in a particular postal mailing list. A subset of list members may then be selected from the 

30 list and a test e-mail will be sent to those selected list members. The subset of list 

members can be selected randomly, or can be selected with an eye toward various factors 
such as the demographics of the particular members, because the postal mailing lists are 
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already compiled based on such factors. In addition, a business can often narrow their 
choice of postal mailing lists to a few that generally match a businesses needs, because 
postal mailing lists often include people of a certain age bracket, geographical area, or 
with a certain purchasing history. 
5 A broker selling mailing lists can offer to pretest some of the possible lists for a 

prospective buyer/renter in order to assure them that they are getting the best list for their 
money. A broker can charge a small fee or provide the service for free. Alternatively, the 
broker may inflate the fee associated with the resultant mailing list. 

As another contextual example, consider a world-renowned author who has 
10 recently published his latest book on cryptography. Rather than spending a lot of money 
on a mailing list without any indication of its effectiveness, the author decides to pre-test 
several possible mailing lists. The author picks lists A, B, C, and D to pretest. A subset of 
individuals from each list is selected. A test e-mail is sent to these individuals, in which 

4| the e-mail contains an offer for a free newsletter on cryptography written by the author. 

L|S The response rate (i.e. number of people accepting the offer) of each mailing list is then 

^ compiled and the list with the highest response rate is chosen as the best one to be 

OS purchased/rented by the author. 

7 Turning now in detail to the drawings, Figure 1 is a system overview of an 

y3_ embodiment of the present invention. In this embodiment, central server 100 provides the 
'0) mailing list test service. Central server 100 can send an e-mail to user terminal 101, user 
^ terminal 102, user terminal 103, utilizing, for example, bulk e-mail software such as that 
yj available from Acxiom/Direct Media, Inc., a provider of online direct marketing 

management software. Each of the user terminals 101, 102 and 103 correspond to postal 
mailboxes 101a, 102a, and 103a, respectively. In other words, the person who receives e- 
25 mail at user terminal 101 also receives postal mail at postal mailbox 101a, the person who 
receives e-mail at user terminal 102 also receives postal mail at postal mailbox 102a, and 
the person who receives e-mail at user terminal 1 03 also receives postal mail at postal 
mailbox 103a. The owners of postal mailboxes 101a, 102a and 103a are part of a single 
mailing list, which typically includes other members. 
30 After sending test e-mails to user terminals 101, 102 and 103, central server 100 

may receive one or more responses to the test e-mails from some or all of the user 
terminals 101, 102, and 103. This action is performed for a number of mailing lists, and 
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based on the responses received by central service 100, an appropriate mailing list is 
selected for use. 

According to one embodiment of the present invention, all the test e-mails sent to 
list members include the same content. In another embodiment of the present invention, 
5 the test e-mails sent to list members can include different content for different list 
members. 

There are a variety of ways of detecting responses to, or interest in, the subject 
matter of the e-mail in order to determine the expected effectiveness of the associated 
postal mailing lists. In one embodiment of the present invention, the central server 1 00 
10 detects whether recipients of the test e-mails have responded by detecting whether they 
have replied to the e-mail (e.g., by using the "Reply" button). In another embodiment of 
the present invention, the e-mail can include a Universal Resource Locator (URL) to the 
Web site of the business for which the test is being performed. The URL in the test e-mail 
y| can contain an identifier that allows the central server 100 to detect that access via that 
:|| URL is directed from a test e-mail. The URL embedded in a test e-mail can be different 

from the URL(s) available to the general public for that business. The URL(s) embedded 
m in the test e-mails may also be different from each other. Such a system for providing an 
y interactive response to direct marketing utilizing a URL is disclosed in U.S. Patent No. 5, 
CJ 793,972 to Shane. The entirety of U.S. Patent No. 5,793,972, entitled "SYSTEM AND 
Kb METHOD PROVIDING AN INTERACTIVE RESPONSE TO DIRECT MAIL BY 
^ CREATING PERSONALIZED WEB PAGE BASED ON URL PROVIDED ON MAIL 
y| PIECE", filed on May 3, 1996, is incorporated by reference herein as part of the present 
disclosure. 

In another embodiment of the present invention, the test e-mails can include links 
25 to Web sites having subject matter that is similar to that of the prospective postal mailing. 
A Web site can detect where a visitor has come from by, for example, reading the visitor's 
"cookies" stored in the visitor's user terminal. Thus, the Web sites whose links are 
embedded in the test e-mail are able to detect that the visitor has come from a link 
provided in the e-mail. The computer that maintains the Web site can record the number 
30 of visitors that come to the Web site from the e-mail and then forward that information to 
the central server 100. Various methods of determining whether a recipient of an e-mail 
has responded to the e-mail are known to those skilled in the art and need not be discussed 
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in detail herein. 

In one embodiment of the present invention, recipients of the test e-mails can be 

compensated for their response. This can increase the effectiveness of the subsequently 

selected postal mailing list because the recipient associates the business with money that 
5 they have earned/received previously. For the purposes of the present invention, the term 

"compensated" includes, but is not limited to, monetary payment or payment of perceived 

value points (e.g., frequent flyer miles). 

Figure 2 is a schematic block diagram of central server 100 used to provide a 

mailing list test service, according to an embodiment of the present invention. The central 
, ( |0 server 100 includes processor 201 coupled to input device 203, and communications port 
k i 204. The central server 100 also includes data storage device 205. Data storage device 
^ 205 contains instructions adapted to be executed by processor 201 to perform at least one 

embodiment of a method of the present invention. For example, data storage device 205 
0 can store instructions adapted to be executed by processor 201 to first send an e-mail to 
Uj5 each of a subset of list members for each mailing list stored in mailing list database 202, 

then to receive at least one response to the sent e-mails, and to select a postal mailing list 
G| for use based on the received responses. 

J" For the purposes of the present invention, data storage device 205 can include any 

W medium capable of storing instructions adapted to be executed by a processor. Some 
P0 examples of such media include, but are not limited to, floppy disks, CD-ROM, magnetic 
yj tape, hard disk, RAM, ROM, or any other device that can store computer-readable 
^ information. In one embodiment, the instructions are stored on the medium in a 

compressed and/or encrypted format. As used herein, the phrase "adapted to be executed 
by a processor" is meant to encompass instructions stored in a compressed and/or 
25 encrypted format, as well as instructions that have to be compiled or installed by an 
installer before being executed by the processor. 

As 3how n4 n Figure 2, data storage device 205 stores a program 202a, mailingli^L . 
database 202b, recipient database 202c, test database 202d, questionsjiatabnSse - 202e and 
transaction database 202f. Program 202a includesinsfariCfions for implementing the 
30 present invention, examplesof^dwelr^edescribed in detail what respect to Figures 9-12. 

Yox ^^^^^Q^d^^^'di can implement a method for providing a mailing list test M 
^ •^service involving a plural i ty of mailing lists, each mailing list including information about ^ 
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sold or leased for a direct marketing mailing / 



Mailing list database 202b is described in detail with respect to Figure 3. Recipient 
'I database 202c is described in detail with respect to Figure 4. Test database 202e and 

questions database 202e are described in detail with respect to Figures 5A and 5B. 
10 Transaction database 202f, is described in detail in relation to Figures 6 A and 6B. 
In Figure 3, table 300 is representative of a portion of mailing list database 202b in 
accordance with an embodiment of the present invention. As shown in Figure 3, table 300 
can contain a list identifier 320 that identifies a list. For each postal mailing list, 
y| additional information is provided in various fields that describe the list. Table 300 
lE5 contains (i) a target industry field 322, which describes the industry within which the 
N recipients included on the list have exhibited interest in; (ii) a list member age bracket 
m field 324, which indicates a range of ages of the recipients included on the list; (iii) a list 
y member geographical location field 326, which indicates the general location within which 
P the recipients included on the list reside; (iv) a list member salary bracket field 328, which 
pio indicates a salary range of the recipients included on the list; and (v) a price field 330, 
\I which indicates the cost of the list for purchase or rental. For example, according to table 
yj 300 shown in Figure 3, list A pertains to a target industry of PC technology. The list 
members in list A are 1 8-25 years old, live in the northeastern United States, and earn 
between $15,000 and $30,000 per year. The price of list A is $2,000. 
25 In Figure 4, table 400 is a tabular representation of a portion of recipient database 

202c according to an embodiment of the present invention. Table 400 contains contact 
information for each list member appearing on at least one of the postal-mailing lists 
offered by the central server 100 (Fig. 1). As shown in Figure 4, each recipient, that is, 
each person on a postal-mailing list to whom a test e-mail can be sent, is identified by a 
30 recipient identifier field 420, a recipient name field 422, a recipient postal address field 
424, a recipient e-mail address field 426. In addition, the table 400 shown in Figure 4 
includes the identifier of the list or lists to which a given recipient belongs, indicated in the 
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list identifier field 428. For example, John Doe is identified by his recipient identifier 
"12345". His postal address is 10 New St., Town USA, and his e-mail address is 
doe@aol.com. Finally, recipient John Doe is a list member of postal mailing list A and 
postal mailing list E. 

5 Figure 5 A is a record 500, representative of a record of test database 202d in 

accordance with an embodiment of the present invention. Record 500 includes, for each 
test identifier, identified in the test identifier field 502, (i) a recipient identifier field 504 
that identifies the recipient who received this particular test e-mail; (ii) a mailing list 
identifier field 506 that identifies the mailing list from which the particular recipient was 
10 chosen, and (iii) a response field 508, which indicates whether the recipient responded to 
the test e-mail (e.g., "Y" for yes, or "N" for no). In one embodiment of the present 
invention, a determination of the most successful mailing list can be made from this 
database by querying the record 500 for the number of the "Y" responses for each 
yj particular mailing list identifier. 

}f5 According to another embodiment of the present invention, the test e-mail contains 

"jj questions. In this embodiment, responses received by central server 100 (Fig. 1) include 
£33 answers to the questions. The answers are subsequently extracted from the response and 
^ analyzed. A mailing list can be chosen based on either the response rate of a given list, or 
C? based on the answers supplied by the list members. For example, a mailing list can be 
0) chosen based on the number of responses that include a predetermined answer or type of 
^ answer. 

yj Another embodiment of the present invention provides for testing simplified 

product variations, thereby reducing marketing costs involved in product testing. 

Typically, businesses do not know the most effective layout, color scheme or information 
25 content in a marketing brochure. To alleviate this problem, the present system can be used 

by a business to pre-test various versions of the postal mailing brochure before incurring 

the costs of printing such brochures. 

As an example of this embodiment, the test e-mails can contain various versions, 

such as versions of a product brochure. The business can send one color scheme version 
30 in one batch of test e-mails (i.e. one mailing list) and another color scheme in another 

batch. A mailing list, and thus a color scheme, can be selected based on the response to 

the various test e-mails. Alternatively, a mailing list may be created by aggregating 
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responses (e.g. favorable responses). 

Other features that a business can pre-test via test e-mails include (i) the 
informational content of the postal mailing; (ii) the layout of the postal mailing; and (iii) 
other related products to be included in the postal mailing. When the results of test e- 
mails are available, the business will not only know which postal mailing is most effective 
for their product but also will gain some valuable insights into which version of the postal 
mailing brochure is predicted to be the most effective. 

The business can also include in the test e-mails survey questions that elicit 
respondent feedback, such as what other kind of information the respondent might want to 
see in the postal mailing or what aspects of the test e-mail the respondent did or did not 
like. The business can gather and analyze these responses to refine the future postal 
mailings. 

The e-mail testing system can pre-test variations of products and select the 
variation with the highest response rate or the most favorable response rate. For example, 
the design of a cereal box can be pre-tested in such a way. A manufacturer can design 
several different color schemes for the box, attach images of the designs to the test e-mails 
and send the test e-mails to a set of recipients. The design that receives the most responses 
or the most favorable responses is the one chosen by the manufacturer as a likely 
candidate for further enhancements and modifications to be tested via a postal mailing. 

As another example, consider a business that sells novelty technology items. The 
business would like to buy/rent a mailing list and, based on their demographic 
requirements, the business has the option of buying or renting one of three mailing lists, A, 
B, or C. To determine which would be the most effective list for them to buy or rent, the 
business sends out a test e-mails, which contain a description of a new product from their 
latest catalog. 

In this example, there can be two versions of the description, each containing a 
different picture of the item. Some of the test e-mails contain the first version and some of 
the test e-mails contain the second version. The central server 100 (Fig. 1) sends the test 
e-mails to a subset of each mailing list A, B, and C. Based on the responses to the e-mails, 
the system determines (i) which mailing list generated the most responses; and (ii) which 
version of the e-mail generated the most responses. Each e-mail sent out includes an 
indication of the mailing list that the recipient of the e-mail belongs to and the version of 
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the e-mail. Thus when the central server 100 (Fig. 1) receives a reply to the e-mail it is 
able to recognize and record the recipient and version. When the business receives the 
results of the test, they are able to select the most effective presentation of the product (e.g. 
which picture of the product generated the most responses) as well as the most effective 
mailing list for their type of product. In general, the test e-mails sent can have different 
content from one another. 

Accordingly, the present invention may be utilized, via central server 100 (Fig. 1), 
to gather data from the responses and to determine the number of responses. In other 
words, the test e-mails can be used as questionnaires or surveys regarding (i) the product, 
or (ii) potential consumer concerns and/or preferences. Thus, when the responses to the 
test e-mails are received by central server 100 (Fig. 1), not only does the central server 100 
(Fig. 1) tally the number of responses from each postal mailing list subset but it also 
accumulates the responses to the questions within the test e-mails and stores them for 
subsequent analysis. For example, a response to the test e-mails can include the rating of 
the content of the test e-mails, and a content preference rating can be determined and used 
to select the mailing list from the plurality of mailing lists. Using the responses received, 
and based on pre-selected criteria such as demographics or response rate, a custom postal- 
mailing list can be created. 

As an example, assume a business is considering postal-mailing lists A, B, C, and 
D for rental. The business is also debating whether, on the one hand, to include a detailed 
description of their product in the catalog, or on the other hand, to present only high-level 
description of the product. Thus, when the central server 100 (Fig. 1) sends out test e- 
mails to the individuals of the subset of each potential mailing list, the e-mail will include 
a survey question that identifies which of the two descriptions are preferred. For example, 
the questionnaire can present two versions of a product description, one focused on 
technical description of the product and one focused on the high level description of the 
product. The questionnaire can include a request to indicate the preferred version of the 
product description. Once the business receives the results (possibly from the central 
server 100 (Fig. 1)), the business is able to determine not only which mailing list resulted 
in the most responses, but also which version of the product description the majority of the 
recipients preferred. 

Figure 5B is a tabular representation of a portion of a test database record 550 and 
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two question database records 560 and 570. The records in Figure 5B can typically be 
used in an embodiment of the present invention in which the test e-mails are also used to 
collect feedback on the potential postal mailing. In the exemplary test database record 550 
illustrated in Figure 5B, for a given test identified by a given test identifier 551, each 
5 recipient is identified by a unique recipient identifier 552. The postal-mailing list for 
which the recipient is a list member is identified with a mailing list identifier 554. The 
question sent to the recipient is identified with a question identifier 556 and the answer 
identifier included in the recipient's response to the test e-mail is stored in answer 
identifier 558. The answer identifier for a given entry is set to "N/A" until such a time as 
10 when an answer identifier is received from a recipient corresponding to the entry. 

The questions database records 560 and 570 in Figure 5B are tabulated to show 
that, for each test identifier, mailing list identifier, and question sent in the test e-mail, an 
answer identifier and its corresponding answer is stored. In the example of Figure 5B, 
y5 each of the test e-mails sent out from the various mailing list subsets contain the same two 
yfe questions and corresponding answer choices. In other embodiments, the mailing list test 
^ J can include different questions for each of the subsets. 

In Figure 6A, table 600 is representative of a portion of an exemplary transaction 
^ database 202f that can be stored in data storage device 205 according to an embodiment of 
p the present invention. As shown in Figure 6A, the transaction database 202f records each 
go of the transactions (i.e. tests) performed by the central server 100. Specifically, the 
^ transaction database can store, for each business using the mailing list test service, a test 
jj identifier 620, a business identifier 622, a mailing list identifier 624, how many test e- 
mails were sent 626 for each mailing list identifier, how many responses were received 
628 from the test e-mails, and the response rate 630 for that mailing list, or any subset of 
25 these categories. For example, business "1 1 1-222" sent, to 2,000 list members of postal 
mailing list A, a test identified by test identifier "0098". Twenty responses were received, 
giving a response rate of 1%. In addition, business "1 1 1-222" sent the same test to 2,000 
members of postal mailing list E. Forty responses were received, giving a response rate of 
2%. 

30 In Figure 6B, table 650 is representative of a record of transaction database 202f in 

accordance with an alternate embodiment of the present invention. Table 650 may be used 
in the embodiment wherein the test e-mails are used to obtain feedback on the potential 
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content of the postal mailings. Table 650 can identify a transaction by the business 
identifier field 652 that identifies a business requesting the mailing list test service and the 
test identifier field 654 that identifies the test identifier used for each postal-mailing list 
examined. Specifically, in Table 650, postal-mailing lists were tested for a business 
5 identified by business identifier "222-333". This test is identified by a test identifier 

"0099". The test e-mails of Table 650 were sent to list members of mailing lists A, B and 
C, indicated by mailing list identifier field 664. Each test e-mail includes two questions, 
identified by question identifier field 666. 

The two questions included in test "0099" are identified as "Ql" and "Q2". The 
10 possible answers to each question "Ql" and "Q2" are identified in the answer identifier 
field 668. Question "Ql" has two possible answers, identified by answer identifiers "Al" 
and "A2", respectively. Question Q2 has two possible answers, identified by answer 
identifier A3 and A4, respectively. The test e-mails were sent to 2,000 recipients of each 
yj mailing list A, B, and C, as indicated in the Number Sent field 670. The number of 
y§> responses received for each answer choice within each mailing list is indicated in the 
" 4 Number of Responses field 672. The response rate for each answer choice within each 
m mailing list is indicated in the Answer Response Rate For Mailing List field 674. For 
^ example, 20 recipients of mailing list A responded to question "Ql" with answer choice 
C3 "Al", therefore the response rate for mailing list A, answer "Al" is 1.0% ((20/2000) * 100 
2fo = 1 0). The total response rate for each mailing list is indicated in the Total Mailing List 
r; Response Rate field 676. For example, thirty-four recipients of mailing list A responded 
yj to the test e-mail, as indicated by the total number of responses for each question within 
each mailing list (i.e. for mailing list A, 20 recipients selected answer choice Al for Ql 
and 14 recipients selected answer choice A2 for Ql, resulting in a total of 34 responses to 
25 Ql). Thus the total response rate for mailing list A is 1 .7% ((34/2000) * 100 = 1.7). 

Table 650 also contains the total response rate for each answer choice, regardless of the 
mailing list associated with it. The total response rate for answer Al, A2, A3, and A4 is 
indicated in Answer Identifier/Response Rate fields 656, 658, 660, and 662, respectively. 
For example, the total response rate for answer Al was 1 .2%. That is, for the 6,000 
30 recipients who received Ql (2,000 recipients for each of the three mailing lists A, B, and 
C), seventy-four selected answer choice Al (20 recipients from mailing list A + 1 8 
recipients from mailing list B + 36 recipients from mailing list C = 74 recipients). That 



13 



results in a total response rate of 1.2% for answer choice Al ((74/6000) * 100 = 1.2). 

'/t* — TTip in fnr mft^^ Tirprp ntp H i n H Tfi falp ^S O m a y hp I i ti1i7 

on the content of the postal mailing to be sent out based on the results of the tes^€<mails. 
For example, let's say that Ql comprised the question "Which layout do yptiprefer?" and 
5 answer choice Al comprised a first potential layout and answer choip^A2 comprised a 
second potential layout. The results of the test "0099" indicate^tfiat the majority of 
recipients preferred the first potential layout, since Al h^a higher response rate than A2. 
Alternatively, referring to the same example, the bprfness may choose to utilize the results 
from each mailing list individually. For exapatrie, the business may choose to send a 
10 postal mailing to recipients of all three^lailing lists A, B, and C, but to include different 
layout for the recipients of the re^p^ctive mailing lists. In such a scenario, mailing list A 
recipients will receive the AHayout, since the majority of mailing list A recipients 
preferred the layout^atrcsponding to Al . Mailing list B recipients will receive the A2 
di layout, since th^majority of mailing list A2 recipients preferred the layout corresponding 
y& to A2. SiRxilarly, mailing list C recipients will receive the Al layout, since the majority of 
maiJifLg list C recipients preferred the layout associated with Al . In this manner, a 
■ usincss may maximize the pot ential-respo nse rate to a poatal mailing ^^ 
y Figures 7, 8, 9 and 10 are flow charts illustrating methods of preparing a mailing 

CJ list test and analyzing and using the results. As shown in Figure 7, at step 701, a plurality 
So of postal mailing list selections is received. These postal-mailing lists can be stored in a 
r * postal-mailing list database. At step 702, a subset of list members of each of the plurality 
y| of postal mailing lists is determined. This determination can occur at random, or in a 

predefined manner (e.g., the first 100 list members from each list are selected). A test e- 
mail is then sent, at step 703, to each recipient included in the determined subsets. As 
25 discussed above, the test e-mails can all have the same content, or can have content 

different from one another. For example, each test e-mail can be the same advertisement 
for a product, or one or more test e-mail can be a different advertisement for a product 
from the other test e-mails. Each test e-mail can contain the same question, or one or more 
test e-mails can contain a different question from the other test e-mails. 
30 At step 704, responses to the test e-mails are received. These responses will 

typically be fewer than the number of test e-mails that were sent. At step 705, a response 
rate is determined for each subset of test e-mails. The subset with the highest response 
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rate is then selected at step 706, and its associated postal mailing list is queued for mailing. 
Note that at step 706, depending on the response received, a subset can be chosen based on 
responses weighted by demographics using a demographic identifier. Likewise, a subset 
can be chosen based on any generalized function of the responses received, including the 
content of the responses. 

Figure 8 is a flowchart depicting a method of creating an e-mail test according to 
an embodiment of the present invention. As shown in Figure 8, e-mail content is received 
in step 801. E-mail content can include questions, pictures, questionnaire layout, etc. At 
step 802, a postal-mailing list selection is received, and which test is to be sent, identified 
by a test identifier, is determined at step 803. At step 804, a subset of list members for 
each selected postal-mailing list is identified. A new record is then created in the test 
database at step 805. The new record is based on the test identifier. In addition, in this 
step, all respondent identifiers corresponding to a mailing list identifier are stored. 

At step 806, the e-mail address for each respondent of each subset is determined, 
and the test e-mails are prepared at step 807. Finally, at step 808, the test e-mails are 
transmitted to the appropriate respondents based on the e-mail address. 

The step of preparing test e-mails can comprise combining the e-mail content 
received in step 801 and the test identifier determined at step 803, respectively, with (i) the 
respondent e-mail address, (ii) the respondent identifier, and (iii) the mailing list identifier 
or identifiers corresponding to each respondent. In one embodiment of the present 
invention, the process illustrated in Figure 8 can utilize the test database of Figure 5 A. For 
example, the test identifier determined at step 803 can refer to a recipient identifier, a 
mailing list identifier and a response. In another embodiment of the present invention, this 
process can utilize the test database of Figure 5B. In other words, aside from a recipient 
identifier, the test identifier determined in step 803 can refer to, aside from a recipient 
identifier, a mailing list identifier, a question identifier, and an answer identifier. In one 
embodiment, the step of preparing the test e-mails can also include attaching the 
appropriate questions from the question database, based on the test identifier, to the test e- 
mails. 

Figure 9 is a flowchart of a method of receiving a response to a test e-mail 
according to an embodiment of the present invention. As can be seen in this figure, a 
response to a test e-mail is received at step 901. Once the response is received, the various 
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identifying parameters of the test e-mail can be determined. At step 902, the e-mail's test 
identifier is determined. At step 903, the e-mail's respondent identifier is determined. A 
record is then retrieved from the test database at step 904. The record retrieved is based 
on the test identifier. The response is then marked in the database at step 905. In one 
5 embodiment of the present invention, the response is marked in the database by changing 
the response corresponding to the recipient identifier to "Y." In one embodiment of the 
present invention, this process would use the test database of Figure 5 A. For example, the 
test identifier received at step 904 can refer to a recipient identifier, a mailing list 
identifier, and a response. In another embodiment of the present invention, this process 
10 can utilize the test database of figure 5B. In other words the test identifier received in step 
904 can refer to, a mailing list identifier, a question identifier, and an answer identifier 
aside from a recipient identifier. 

Figure 10 is a flowchart of a method of analyzing the results of the e-mail test and 
M selecting the most effective postal mailing list to use according to an embodiment of the 
plf5 present invention. At step 1001, it is determined whether the test is completed. This 
s _i determination can be made, for example, by limiting the amount of time for response and 
HI4 then determining whether that amount of time has elapsed. 

yj At step 1002, the responses for each mailing list are totaled, and at step 1003, the 

!L appropriate record is retrieved from the transaction database. The appropriate record is 
l^b identified based on a test identifier received in the response. The total number of 
U responses for each mailing list are stored at step 1004. At step 1005, the response rate of 
^ % each mailing list is calculated corresponding to the test identifier based on the number of 
test e-mails sent and the number of responses received. The mailing list corresponding to 
the test identifier with the highest response rate is then selected at step 1006. At step 
25 1007, that mailing list is queued for the postal-mailing process. 

The present invention is not limited to the variations described herein. Other 
variations will be apparent to one of ordinary skill in the art. For example, in another 
embodiment of the present invention a system and method is provided for creating a 
custom postal mailing list based on responses to test e-mails. In this embodiment, rather 
30 than using test e-mails to predict the response rate of an existing postal mailing list, the 
test e-mails are used to create a custom postal mailing list. To do this, a number of postal 
mailing lists are chosen, subsets of recipients are chosen from each, and a test e-mail is 
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sent to each recipient. The identities of the respondents to each of the e-mails are 
determined and a postal mailing list is compiled from the responsive recipient identities 
and retrieved postal addresses associated with each. 

■ ' As an example of this embodiment, assume postal mailing list A contair 
5 individuals 1 through 1000, postal-mailing list B contains individuals^0vthrough 2000, 
and postal-mailing list C contains individuals 2001 through 3QQ(l The first 100 
individuals out of each mailing list are selected as tlje^ubsets for the test e-mail (i.e. 
individuals 1 through 1000, 1001 through^WlTand 2001 through 2101). Assume in this 
example that individuals 10 ^01^10^60 through 90, 1080 through 1090, 2006 through 
2016, and 2065 through^OSO respond to the e-mail). Based on these responses, a new 
Mailing List Dis^feated that contains individuals 10 through 20, 60 through 90, 1080 
througlrlt)90, 2006 through 2016, and 2065 through 2080. The postal mailing can then be 
sent out to the individuals on postal-mailing list 

Thus, as shown above in the various embodiments and examples, the various 
problems in the prior art are overcome by the present invention. In particular, the present 
invention, as described above, provides an efficient and cost effective way of testing, 
selecting and creating a mailing list that is appropriate to a business' s needs. 

The present invention has been described in terms of several embodiments solely 
for the purpose of illustration. Persons skilled in the art will recognize that the invention is 
not limited to the embodiments described, but can be practiced modifications and 
alterations limited only by the spirit and scope of the appended claims. 
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